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REVIEW OF SCHOOL SPENDING AND STUDENT 
ACHIEVEMENT IN MICHIGAN: WHAT’S THE 
RELATIONSHIP? 


Bruce D. Baker, Rutgers University 


1. Introduction 


In the spring of 2016, the Mackinac Center for Public Policy released a report titled “School 
Spending and Student Achievement in Michigan: What’s the Relationship?” (hereinafter re- 
ferred to simply as the Mackinac report). The report appears to have been produced in part 
as a pre-emptive strike challenging the validity of a “comprehensive statewide cost study” 
contracted by the Michigan Legislature to determine the costs of achieving desired outcome 
standards, and expected to be released on May 13th. Combining a facile empirical analysis 
with a highly selective review of existing literature, the Mackinac report broadly challenges 
whether money matters for improving school quality (as measured by student outcomes) 
generally, or for Michigan schools in particular. 


The authors assert that marginal increases to the already “high” levels of spending in Mich- 
igan would likely yield little or no gain in student outcomes and that additional dollars al- 
located to the system as it presently exists would therefore be inefficient (contending, e.g., 
that spending on increased salaries or reduced class sizes is inefficient). Whether assert- 
ing that present spending levels are uniformly high across all children, districts, or schools 
statewide, or perhaps just high on average, the report never substantiates this key assertion. 
It fails to acknowledge research showing positive effects of reforms providing additional 
funding and finding that this increased funding was allocated primarily toward traditional 
investments (increased teacher salaries and smaller class sizes). Finally, the authors’ own 
empirical analysis falls short when compared to the three existing peer-reviewed studies, 
and one non-peer-reviewed study, each finding positive effects of prior school finance re- 
forms in Michigan. 


Il. Findings and Conclusions of the Report 


The Mackinac report claims to address three issues: 


1. Whether money for schools in general, or money driven to specific schools and 
districts through state school finance reform can be expected to lead to improved 
schooling quality as measured through student outcomes; 


2. Whether in the state of Michigan, there exists any relationship between school 
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funding and school quality; and 


3. The validity of attempts to derive cost estimates tied to student outcomes for 
setting future levels of funding for Michigan schools and for guiding state school 
finance reforms. 


Through a highly selective, largely dated and inadequate review of literature, the report as- 
serts, “The bulk of the academic research suggests that there is no statistically meaningful 
correlation between school spending and student outcomes” (p. 2). Based on a new statis- 
tical analysis, it then concludes, “Based on these results, it is unlikely that injecting new 
resources into Michigan’s public school system, all else remaining equal, will make a mean- 
ingful difference in improving student achievement” (p. 9). 


Much of the report presents a (slightly) more nuanced perspective than the bold conclusive 
statements above. Regarding school finance reform generally, and for Michigan in particu- 
lar, it implies: 


a. The research indicates that, at best, relatively large investments yield relatively 
modest or small increases; 


b. But those increases only matter(ed) where prior spending was/is low, and given 
that presently in Michigan, all spending is high, little or no marginal effect can 
be expected; and 


c. Citing Hanushek (2001),' investments in traditional structures of schooling 
(salaries and class sizes) are unlikely to yield any positive effects because of the 
inefficiencies of those structures. 


As explained below, the report mischaracterizes the substantial body of major peer-reviewed 
works, including studies of Michigan. Specifically, the authors ignore major national studies 
and Michigan-specific studies on the effectiveness of investment in traditional educational 
inputs—specifically teacher salaries and class sizes. They also provide no evidence regarding 
what types of reforms or changes to resource allocation might be more cost-effective than 
these traditional investments. 


Ill. The Report’s Rationale for Its Findings and Conclusions 


The report bases its main conclusions on a selective review of school finance literature, plus 
a series of simple regression models and scatterplots relating school spending and student 
outcome measures for Michigan schools. As explained below, both approaches fail to sup- 
port the report’s claims in the face of substantial countervailing evidence, much of it specific 
to Michigan. 
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IV. The Report’s Use of Research Literature 


Does Money Matter for Schools? 


The report provides a brief (less than two-page) review of the research literature. The bulk 
of the first page is consumed with a summary of a nearly 20-year-old (Hanushek, 1997) re- 
view of 30- to 50-year-old, primarily crude, correlational studies of the relationship between 
spending measures and outcome measures.” The thesis of this review is that: 


The bulk of the academic research suggests that there is no statistically mean- 
ingful correlation between school spending and student outcomes. In cases 
where the correlation is positive and statistically significant, the effects are 
quite small—suggesting that even large increases in spending are likely to 
translate into only small academic effects, on average. (p. 2) 


In a recent report Revisiting the Age Old Question: Does Money Matter in Education (2"4 
Edition), 3 I chronicle the various waves of research on the effect of money in schools. In 
that report, I explain the empirical shortcomings of the literature summarized by Hanushek 
(1997).4 I also summarize the more rigorous, high-quality studies of the same era‘ as well 
as subsequent re-analyses of data from that era,° which document a more positive role of 
schooling resources. Further, I explain that this 20- to 30-year-old debate’ over correlation- 
al studies relating spending and outcomes at high levels of aggregation (schools, districts, 
states and nations), is largely moot, given the vast body of more recent, more precise, and 
more statistically rigorous literature evaluating the short- and long-run impact of school 
finance reforms on student outcomes. 


One recent major national study by Jackson, Johnson and Persico (2015)® found that in- 
fusions of funding to districts serving low-income children have substantive long term im- 
pacts. The Mackinac report attempts to trivialize this study by asserting that the infusions 
of funding were helpful to only specific children and the effects relatively small at very high 
cost. “This research,” the report authors contend, “suggests that it may be possible to boost 
student achievement through spending more on certain types of schools, but it has limita- 
tions. For instance, it finds statistically meaningful positive outcomes for some students 
only after they were exposed to a 10 percent increase in spending every year for 12 consecu- 
tive years of schooling” (p. 2, internal footnote omitted). 


By contrast, Jackson, Johnson and Persico characterize their own findings as 
follows: 


Thus, the estimated effect of a 22 percent increase in per-pupil spending 
throughout all 12 school-age years for low-income children is large enough 
to eliminate the education gap between children from low-income and non- 
poor families. In relation to current spending levels (the average for 2012 was 
$12,600 per pupil), this would correspond to increasing per-pupil spending 
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permanently by roughly $2,863 per student. 


Specifically, increasing per-pupil spending by 10 percent in all 12 school-age 
years increases the probability of high school graduation by 7 percentage 
points for all students, by roughly 10 percentage points for low-income chil- 
dren, and by 2.5 percentage points for nonpoor children. 


For children from low-income families, increasing per-pupil spending by 10 
percent in all 12 school-age years boosts adult hourly wages by $2.07 in 2000 
dollars, or 13 percent.? 


In addition to this mischaracterization of the Jackson, Johnson and Persico study, the re- 
port fails to consider an even more recent national analysis, conducted by Lafortune, Roth- 
stein and Schanzenbach (2015),'*° which concluded: 


Using test score data from the National Assessment of Educational Progress, 
we also find that reforms cause gradual increases in the relative achievement 
of students in low-income school districts, consistent with the goal of improv- 
ing educational opportunity for these students. The implied effect of school 
resources on educational achievement is large." (p. 1) 


School Finance Reforms in Michigan 


The Mackinac report faces an uphill battle in asserting the relative unimportance of school 
finance reform in Michigan, because it is one of the few states for which several peer-re- 
viewed empirical studies have already found positive effects of previous reforms (finance 
reforms addressing inequities that have since re-emerged, as discussed below). It attempts 
to discount two peer-reviewed studies from the highly respected journals Education Finance 
and Policy (Roy, 2011) and The Journal of Public Economics (Papke, 2005) with the follow- 
ing explanation: 


These two studies have limited relevance to the current debates about school 
funding in Michigan, however. It’s unlikely that public schools would again 
receive large increases in funding like the ones these studies analyzed; cur- 
rent policy debates about school resources only concern marginal changes 
to school funding levels. Additionally, their findings show the most positive 
gains for relatively low-spending schools and little or no gains for relatively 
high-spending schools. Per-pupil funding has increased in real terms since 
the time period examined by these studies, and most Michigan schools today 
would be high spending ones if compared to the schools these studies ana- 
lyzed. (p. 3) 


So, rather than incorporating the conclusions of these Michigan-specific studies into their 
broader assessment of the role of money, school finance reform and schools (instead, opting 
to rely on the 20-year-old review of non-Michigan studies to address that broader question), 
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the authors assert that the studies lack relevance to the present policy debate in Michigan. 


In Revisiting the Age Old Question: Does Money Matter in Education (2™ Edition), I ex- 
plain Papke and Roy’s findings as follows, along with a third not yet peer-reviewed study by 
Hyman (2013): 


Studies of Michigan school finance reforms of the 1990s have shown positive 
effects on student performance in both the previously lowest-spending dis- 
tricts and previously lower-performing districts.*? For instance, Roy (2011) 
found that Michigan’s school finance reforms of the 1990s led to a significant 
increase among previously low-spending districts. Roy, whose analyses mea- 
sure both whether the policy resulted in changes in funding and who was af- 
fected, found that Michigan’s school finance plan “was quite successful in re- 
ducing interdistrict spending disparities. There was also a significant positive 
effect on student performance in the lowest-spending districts as measured in 
state tests” (abstract).'4 


Similarly, Papke (2005), also evaluating Michigan school finance reforms of 
the 1990s, found that “increases in spending have nontrivial, statistically sig- 
nificant effects on math test pass rates, and the effects are largest for schools 
with initially poor performance” (p. 821). 


Most recently, Hyman (2013) also found positive effects of these Michigan 
school finance reforms, but the paper raised some concerns regarding the dis- 
tribution of those effects. Hyman found that much of the increase was tar- 
geted to schools serving fewer low-income children. However, the study did 
find that students exposed to “$1,000, or 12%, more spending per year during 
grades four through seven experienced a 3.9 percentage point increase in the 
probability of enrolling in college, and a 2.5 percentage point increase in the 
probability of earning a degree” (p. 1).’° 


The Mackinac report acknowledges but discounts Hyman’s work in a footnote (p.3), assert- 
ing that the study found a relatively high cost of relatively small improvements, but with- 
out comparison to more cost effective alternatives. A fourth peer-reviewed study, from the 
Economics of Education Review, also finds a positive impact of Michigan school finance 
reforms.’” Chaudhary (2009) concludes, “A 60% increase in spending increases the percent 
satisfactory score by one standard deviation. The positive impact of expenditures on test 
performance seems largely due to higher teacher salaries”*® (p. 90). 


Chaudhary’s findings also challenge the assertion put forth by the Mackinac authors that, 
because the structure of the public education system is generally “inefficient,” infusion of 
funding into the current education system structure is unlikely to yield positive effects. 
Chaudhary (2009) finds specifically that infusion of new funding under Michigan’s Pro- 
posal A led primarily to increased teacher salaries and secondarily to reduced class sizes 
and it was through these resource allocations that increased outcomes were realized. These 
findings are entirely consistent with those of Jackson, Johnson and Persico (2015), in their 
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national analysis.” 


Literature on Education Cost Studies 


A secondary critique offered in the Mackinac report is that the state’s ongoing attempt to 
determine the cost of achieving adequate educational outcomes amounts to alchemy. In fact, 
the report was apparently triggered by the state’s decision to contract an outside firm (Au- 
genblick, Palaich and Associates (APA)) to conduct a study of education costs—a study that 
may then inform the design of an updated foundation aid formula. The Mackinac authors 
rely on Guthrie and Springer’s (2007) critique of education cost studies and a Hanushek 
Education Next article (2005).”° Yet a wider and more balanced literature on this topic does 
exist.*? 


The report includes three main critiques of APA studies: (a) the majority of studies conduct- 
ed by APA resulted in proposed increases in funding, (b) studies based on prescribed staff- 
ing inputs have yielded different prescriptions from one state to the next, and (c) studies 
based on school spending behavior have resulted in wide variations, implying that “adequate 
levels of funding can vary district by district or school by school” (p. 4). 


Whether the cost of achieving adequate outcomes is more or less than what is currently be- 
ing spent is context specific, depending on the outcome goals in question, on prior and exist- 
ing levels of spending, and on factors that affect the costs of achieving those outcome goals. 
Indeed, cost studies should not find that districts already exceeding specific standards with 
current resources require additional resources merely to meet those standards, and some 
studies by APA deserve critique for that reason.”? 


It may make sense, however, where state outcome goals and regulatory requirements exist, 
that staffing prescriptions from input-oriented analysis differ across states. The presence 
of such variations across studies is an insufficient basis for condemning their validity.*3 I, 
along with Jesse Levin (2014) and previously in a National Research Council report with 
Lori Taylor and Arnold Vedlitz (2008), have raised concerns regarding the usefulness for 
determining “costs” by relying on mere calculations of the average spending of schools or 
districts meeting specific outcome standards (Successful Schools/Districts method).*4 To 
summarize, the Mackinac report assertion that any and all attempts to guide school finance 
policy with cost analysis are alchemy is refuted by more thorough reviews of methods for 
conducting such analysis. > That said, the authors are correct to assert that the “successful 
school districts” approach is not generally a valid method for determining education “costs.” 


V. Review of the Report’s Methods 


The report concludes with an empirical analysis intended to validate that there exists little 
or no relationship between school spending and a variety of outcome measures for Michigan 
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schools. The authors apply two methods: (a) school fixed effects regression analysis mod- 
eling, to determine whether year-over-year, within-school changes in spending are associ- 
ated with concurrent year-over-year changes in the various outcome measures (from 2007- 
2013);° and (b) scatterplots of the relationship between changes in school-level spending 
and changes in school-level outcomes from 2007 to 2013. Based on their models, the authors 
find that for 27 of 28 academic indicators no statistical relationship exists between changes 
in spending and changes in those indicators. 


The Mackinac results differ from the three peer-reviewed studies, and one rigorous non- 
peer-reviewed study, addressed earlier. These different findings may arise in part as a func- 
tion of the different time frames studied, but the differences also arise because of differences 
in measures and models used. First, the Mackinac authors use data from 2007 to 2013, 
asserting that one reason earlier studies may have found a more positive impact is that all 
Michigan districts were spending at much higher levels by the time period of the Mackinac 
study. Thus, they argue, the benefits of previous increases are unlikely to be realized by fur- 
ther increasing spending. 


Figure 1 refutes the premise that Michigan per-pupil spending has risen substantively since 
the reform periods studied by other researchers. Adjusted for labor costs, both regional- 
ly and over time (expressed in year 2000 dollars), Michigan per-pupil spending has risen 
slightly over time, but still slower than states in the same region—called “Regional Educa- 
tion Laboratory Midwest” —falling from the middle of the pack to near the bottom by the 
end of the period. 
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Figure 1. 


Average per Pupil Spending for REL Midwest States 
[Adjusted for Regional and Inflation Costs*] 
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Data Sources: Per Pupil Spending from the Census Fiscal Survey of Local Governments (PPCSTOT),”’ adjusted for 
inflation and regional cost variation using the *Education Comparable Wage Index?’ (expressed in year 2000$). 


Roy (2011) studied the period from 1995 to 2001, Papke (2005) from 1992 to 1998, Chaud- 
hary (2009) from 1995 to 2000 and Hyman from 1995 to 2010. All were attempting to cap- 
ture the effect of a disruptive reform implemented in 1994 (Proposal A). If the goal of poli- 
cymakers moving forward is to implement a new, disruptive reform—one that alters both the 
level and distribution of school spending—these studies, while from an earlier period, are as 
relevant if not more so than a study over a period (2007-2013) where no such reforms have 
been attempted. 


Figure 2 displays the disruptive policy effect investigated by these authors. Proposal A pri- 
marily involved a substitution of local property tax revenue with substantially increased 
state aid to schools, the effect of which was to marginally reduce overall disparity across 
Michigan districts. In particular, Proposal A leveled up revenues of low-property-wealth 
districts. As shown in Figure 2, the reform resulted in an initial stark change; but after about 
2001 state aid began to taper off, and local revenue increase. 
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Figure 2. 


Per Pupil Revenue by Source 
[Adjusted for Regional and Inflation Costs*] 
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Data Sources: State, Local and Federal Revenue from the Census Fiscal Survey of Local Governments,”? adjusted 
for inflation and regional cost variation using the *Education Comparable Wage Index®° (expressed in year 2000$). 


Figure 3 shows the mean and standard deviation of per-pupil spending across Michigan 
districts over time. It therefore offers a way of looking at resource equity. The figure reveals 
that differences between districts that were one standard deviation above and below the 
mean shrunk modestly from 1993 to 2003 and then reverted to their previous levels by 2013. 
So, the period over which the Mackinac authors are studying the effect of funding is one in 
which disparity grew, in important contrast to the period studied by other authors, which 
involved marginal reductions in disparities. 
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Figure 3. 


Mean & Standard Deviation of Michigan per Pupil Spending 
[Adjusted for Regional and Inflation Costs*] 
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Data Sources: Per Pupil Spending from the Census Fiscal Survey of Local Governments (PPCSTOT)", adjusted for 


inflation and regional cost variation using the *Education Comparable Wage Index? (expressed in year 2000$) 


Importantly, each of the other studies includes analyses of the differential effects of in- 
creased funding, either on districts and schools that were previously lower performing or on 
districts that were previously lower spending. 


¢ Papke (2005) specifically finds greater impact of additional resources in those 
schools initially lower performing; 


¢ Roy (2011) similarly splits his sample, but into multiple groups by pre-reform 
spending levels®3 to find that those initially with low spending saw the greatest 
benefits in student outcomes of increased funding; and 


¢ Hyman (2013) finds stronger positive effects on educational attainment for 
schools initially in the bottom half of revenue.*4 


Further, while the Mackinac report’s analysis is most similar to that of Papke (2005), con- 
trolling for low income shares and school size,> the other studies addressed herein include 
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richer sets of controls: 
¢ Roy (2011) accounts for racial and gender compositions and free lunch eligibility; 


¢ Chaudhary (2009) accounts for racial composition, rural status and economies of 
scale (2°¢ order term on district enrollment);°° and 


¢ Hyman (2013), using a student-level data panel, accounts for gender, race, (low) 
income status, English language proficiency and disability status, providing the 
richest set of potentially relevant covariates as well as addressing longer term 
outcomes—college enrollment and degree attainment.?” 


Other non-trivial differences add rigor to the Hyman (2013), Roy (2011) and Chaudhary 
(2009) analyses.3° And again, each of these studies finds substantive, positive effects of 
school finance reforms adopted in the 1990s in Michigan, where those effects are most sub- 
stantial for children attending either previously low-performing or previously low-spending 
districts. Scatterplots lacking any covariates are insufficient to counterbalance the weight of 
evidence provided by these studies. 


VI. Review of the Validity of the Findings and Conclusions 


Given substantial rigorous and peer-reviewed evidence to the contrary, and the empirical 
shortcomings of the report’s own analyses, the assertion that money in general or school 
finance reforms cannot and will not help Michigan’s schools is simply not supported by the 
facts. Substantive school finance reforms in the past have helped those schools in Michigan 
most in need of help at the time. School finance reforms more broadly have been shown to 
help those who were, at the outset of those reforms, the most disadvantaged. The evidence 
produced by the authors of the Mackinac report provides little compelling support for their 
conclusions. 


The report’s discussion section expands on its assertion that introducing money in the cur- 
rent system would be unlikely to produce positive results because of the inefficiencies of the 
structure of that system (citing the work of Hill and Roza (2008) of the Center for Reinvent- 
ing Public Education,%? and again citing Hanushek (2006)).*° The report’s suggestion is that 
any money that might go into traditional investments in the system as it presently exists 
(increased salaries and reduced class sizes) is necessarily less efficient than the preferred 
policy alternatives of Hanushek, Hill, and Roza and the Mackinac authors. At the extreme, 
the contention seems to be that any investments into the system as it currently exists will 
have no positive effect at all (thus each marginal dollar is 100% inefficient). As noted here- 
in, the national research (Johnson, Jackson and Persico, 2015) and the Michigan-specif- 
ic research (Chaudhary, 2009) find otherwise—that money infused through school finance 
reforms, which led to higher salaries and smaller classes, did in fact lead to improved out- 
comes. Further, as explained extensively by Baker and Welner (2011, 2012), claims of vastly 
more efficient or cost-effective alternatives remain unsubstantiated.* 
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Vil. Usefulness of the Report for Guidance of Policy and Practice 


The authors’ conclusion that “it is unlikely injecting new resources into Michigan’s public 
school system, all else remaining equal, will make a meaningful difference in improving 
student achievement” (p. 9) is simply not a credible talking point to inform whether the 
state should or should not consider reforming its school finance system, which may include 
injecting substantial new resources into those schools and districts most in need. The Mack- 
inac report wrongly assumes that all Michigan districts are now high spending and that none 
could benefit from any marginal increase to funding; it fails to evaluate thoroughly the over- 
all level of spending in context, nor does it adequately consider whether and to what extent 
spending varies across children and contexts within Michigan. 


The Mackinac report does, read more carefully (or perhaps generously between the lines), 
identify some nuanced issues of the current policy context of Michigan school finance. The 
authors appropriately express concern that the conversation may be too focused on margin- 
al, across-the-board increases to funding, which might be supported by the pending adequa- 
cy cost study. In doing so, the authors acknowledge that the existing body of research reveals 
positive effects of substantive, sustained school finance reform on those most in need, while 
also pointing out that increased funding to those less in need might be an inefficient endeav- 
or. This bit of wisdom should likely guide Michigan’s legislators as they consider findings 
presented to them from the pending cost study and as they move forward on reforming 
Michigan’s system of school finance. Policy solutions moving forward should focus on areas 
of greatest need, and some children, schools and districts may face greater deficits and have 
greater needs than others in the current policy context, as was the case in the early 1990s.” 
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1 Hanushek, E.A. (2001). Spending on Schools. In T. Moe (Ed.), A Primer on American Education (81-82). 
Stanford, CA: Hoover Institution Press. Retrieved May 9, 2016, from _https://perma.cc/3YHR-MYJS 


2 This is not to condemn the studies of this era but rather to point to the limitations of large scale quantitative 
policy research from the 1950s through the 1980s, the most prominent of which was the Coleman Report of 
1966. These studies, in many cases, did the best they could (some, like Coleman’s, being herculean efforts) 
given the data and methods of their time. In my report Revisiting the Age-Old Question: Does Money Matter 
in Education? 2" Edition (2016), I explain: 


The saga over whether money matters in American public education can be traced back to 
the broader question of whether schools matter. That is, whether schools and school quality 
have any influence on student achievement, educational attainment and future earnings. The 
first national, large-scale quantitative analysis to explore this question was sociologist James 
Coleman’s widely cited “Equality of Educational Opportunity” report, which came about as 
part of the Civil Rights Act of 1964. 


Among other things, the Coleman report explored the relationship between school resource 
measures and student outcomes, finding little relationship between the two. Using the (more 
limited) statistical techniques of the day, Coleman concluded that, on balance, the strongest 
correlations with student outcome measures were not found in schools but rather among 
factors related to parental income, parental education levels and resources in the home. That 
said, among school resource measures, Coleman did find that teacher characteristics were 
positively associated with student outcomes, and more strongly so for minority students 
compared with white students. Nonetheless, the implication drawn by many was that schools 
simply don’t matter. An extension of this implication was that putting more money into 


schools to try to improve quality was unlikely to matter either. 


However, recent re-analyses of the Coleman report data, using up-to-date statistical 
techniques and computing capacity, found that even Coleman’s data indicate that schooling 
quality has significant effects on student outcomes. In one recent example, Konstantopolous 
and Borman (2011) conclude: 


“Our results also indicated that schools play meaningful roles in distributing 
equality or inequality of educational outcomes to females, minorities, and the 


disadvantaged.” 
In a related analysis, Borman and Dowling (2010) report: 


“Even after statistically taking into account students’ family background, a large 
proportion of the variation among true school means is related to differences 


explained by school characteristics.” 


In short, while family background certainly matters most, schools matter as well. 
Furthermore, there exist substantive differences in school quality that explain a substantial 
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